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Abstract 

Though competitive analysis has been a very useful performance 
measure for the quality of online algorithms, it is recognized that it 
sometimes fails to distinguish between algorithms of different quality 
in practice. A number of alternative measures have been proposed, 
but, with a few exceptions, these have generally been applied only to 
the online problem they were developed in connection with. Recently, 
a systematic study of performance measures for online algorithms was 
initiated [Boyar, Irani, Larsen: Eleventh International Algorithms and 
Data Structures Symposium 2009], first focusing on a simple server 
problem. We continue this work by studying a fundamentally different 
online problem, online search, and the Reservation Price Policies in 
particular. The purpose of this line of work is to learn more about 
the applicability of various performance measures in different situa- 
tions and the properties that the different measures emphasize. We 
investigate the following analysis techniques: Competitive, Relative 
Worst Order, Bijective, Average, Relative Interval, Random Order, 
and Max/Max. In addition to drawing conclusions on this work, we 
also investigate the measures' sensitivity to integral vs. real-valued do- 
mains, and as a part of this work, generalize some of the known per- 
formance measures. Finally, we have established the first optimality 
proof for Relative Interval Analysis. 



'Partially supported by the Danish Council for Independent Research. 



1 



1 Introduction 



An optimization problem is online if input is revealed to an algorithm one 
piece at a time and the algorithm has to commit to the part of the solution in- 
volving the current piece before seeing the rest of the input [3] . The first and 
most well-known analysis technique for determining the quality of online al- 
gorithms is competitive analysis |13| \TE[ [15] . The competitive ratio expresses 
the asymptotic ratio of the performance of an online algorithm compared to 
an optimal offline algorithm with unlimited computational power. Though 
this works well in many contexts, researchers realized from the beginning [18] 
that this "unfair" comparison would sometimes make it impossible to dis- 
tinguish between online algorithms of quite different quality in practice. 

In recent years, researchers have considered alternative methods for com- 
parisons of online algorithms, some of which compare algorithms directly, 
as opposed to computing independent ratios in a comparison to an offline 
algorithm. See the references below and |9j for a fairly recent survey. Most 
of the new methods have been designed with one particular online problem 
in mind, trying to fix problems with competitive analysis for that particu- 
lar problem. Not that much is known about the strengths and weaknesses 
of these alternatives in comparison with each other. In [7], a systematic 
study of performance measures was initiated by fixing a (simple) online 
problem and applying a collection of performance measures. Partial conclu- 
sions were obtained in demonstrating which measures focus on greediness as 
an algorithmic quality. It was also observed that some measures could not 
distinguish between certain pairs of algorithms where the one performed at 
least as well as the other on every sequence. 

We continue this systematic study here by investigating a fundamentally 
different problem which has not yet been studied as an online problem other 
than with competitive analysis, the online search problem |12| 111]. Online 
search is a very simple online (profit) maximization problem. Prices, be- 
tween the minimum price of m and the maximum price of M, arrive online 
one at a time, and each time a price is revealed, the algorithm can decide 
to accept that price and terminate or decide to wait. The length of the 
input sequence is not known to the algorithm in advance, but is revealed 
only when the last price is given, and the algorithm must accept that price, 
if it has not accepted one earlier. 

This simple model of a searching problem has enormous importance due 
to its simplicity and its application in the much more complex problems of 



2 



lowest or highest price searching in various real-world applications in the 
fields of Economics and Finance [T7]. The online search problem is very 
similar to that of the one-way trading problem [81 111^ 112], In fact, one-way 
trading can be seen as randomized searching. 

Greediness, as explored in the server problem [7J, has to do with focus on 
which choice to make when advancing from one partial solution to another, 
closer to the end result. The online search problem does not have partial 
solutions, so the findings obtained in this paper are complementary to the 
results obtained in [TJ. 

Our primary study is of the class of Reservation Price Policy (RPP) algo- 
rithms \U\ 112] , This is a parameterized class, where the behavior of 1Z P is 
to accept the first price greater than or equal to the so-called reservation 
price p. 

As a "sanity check" to confirm that the measures "work" at all on this 
problem, we also define IZp, which accepts the second price greater than 
or equal to p, and investigate its relationship to 1Z P . Whereas 1Z P "decides 
what it wants and takes it when it sees it", IZp "knows what it wants, but 
does not take it until the second time it sees it". One would expect 1Z P to 
be the better algorithm. With the exception of Max/Max Analysis, all the 
measures "pass this test" and favor 7Z P , though significant redefinition was 
necessary for Relative Interval Analysis. 

Having that the measures pass this test, we proceed to the more interesting 
task of comparing the different quality measures on RPP algorithms with 
different parameters. We have considered having an integral interval of 
possible prices between m and M as well as a real-valued scenario. For the 
most part, the results are similar. The following discussion is assuming a 
real-valued scenario, allowing us to state the results better typographically, 
without rounding. 

For the performance measures below, note that since profit is a constant 
(between m and M), independent of the sequence length, for measures of 
an asymptotic nature, we use the strict version since asymptotic results 
(allowing an additive constant) would deem all algorithms optimal (ratio 
one compared with an optimal algorithm — up to the additive constant). In 
each section of the paper, we give the precise definition of the measures used. 

We find that Competitive Analysis and Random Order Analysis favor 1Z v /^f • 
the reason being that they focus on limiting the worst case ratio compared to 
an optimal algorithm, independent of input length. Relative Interval Anal- 
ysis favors Tl m +M , similarly limiting the worst case difference, as opposed to 
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ratio. Average Analysis favors TZm- This is basically due to focusing on the 
limit, i.e., when input sequences become long enough, any event will occur 
eventually. In Bijective Analysis, basically all algorithms are incomparable. 
Finally Relative Worst Order Analysis deems the algorithms incomparable, 
but gives indication that 1Z is the best algorithm. 

In addition to these findings, this paper contains the first optimality result 
for Relative Interval Analysis, where we prove that no 1Z P algorithm can be 
better than TZ m+M ■ For Relative Worst Order Analysis, we refine the discus- 
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sion of which algorithm is best by introducing the concept of "domination" , 
which seems to be interesting for classes of parameterized algorithms. A 
limited use of this concept, without naming it, appeared when comparing 
variants of Lazy Double Coverage for the server problem in [7] . 

Finally, we have investigated the sensitivity of the different measures with re- 
gards to the choice of integral vs. real- valued domains, and most of the mea- 
sures seem very stable in this regard. For Bijective Analysis, the situation 
changes from basically all algorithms being incomparable to all algorithms 
being equivalent. Average analysis is inapplicable for a real- valued inter- 
val, but a generalization, which we call Expected Analysis, can be applied, 
giving similar results to what Average Analysis gives for integral values. 

Note that our problem is a profit maximization problem. Thus, for those 
analysis methods which have previously only been defined for cost minimiza- 
tion problems, we have presented profit maximization versions. Both Rela- 
tive Interval Analysis and the Max/Max ratio have previously been defined 
with limits which were inappropriate for a problem such as online search 
where the maximum value achievable by an algorithm does not grow with 
the number of requests. This also led to considering alternative definitions 
which are more appropriate for this type of scenario. 

The rest of this paper is organized as follows. Section [2] defines the notation 
used and each subsequent section treats one of the measures described above. 

2 Problem Preliminaries 

Unless otherwise stated, we assume that the prices are integral and drawn 
from some integral interval [to, M\ with < to < M. In any time step, 
any value from this closed interval can be drawn as a price, and there will 
be iV = M — to + 1 possible prices. This assumption is made for the sake 
of consistency; some methods of analysis are uninteresting for real-valued 
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intervals; see Section [H for example. Also, this assumption is compatible 
with the real- world problems of online search as the set of prices is generally 
finite (the market decides on an agreed-upon number of digits after the 
decimal point). 

We denote the length of the price sequence by n. Denote by Z n the set of 
all input sequences of length n. Thus, the total number of possible input 
sequences of length n is N n . For an online algorithm A and an input se- 
quence /, let A(I) be the profit gained by A on /, i.e., the price chosen. In 
some analyses (for example in Relative Worst Order Analysis), we need to 
permute the input sequences. We always use a as a permutation and denote 
the permuted sequence by a {I). 

We use IZp to denote the RPP algorithm with reservation price p, i.e., the 
algorithm that accepts the first price of at least p and accepts the last price 
of the input sequence if it has not accepted another price before that. We 
let 1Zp denote the similar algorithm that accepts a price of at least p the 
second time such a price is seen. 

Some of the analysis methods compare two online algorithms directly (for 
example Bijective Analysis) and some methods (for example Competitive 
Analysis) compare the online algorithms with a hypothetical optimal offline 
algorithm which receives the input in its entirety in advance and has unlim- 
ited computational power in determining a solution. We denote this optimal 
algorithm by OPT and the profit gained by it from an input sequence I as 
OPT(I), which is the maximum price in that sequence. 

To denote the relative performance of two online algorithms A and B ac- 
cording to an analysis method, x, we use the following notation. If B is 
better than A, then we write A -< x B, and if B is no worse than A, this is 
denoted by A < x B. If the measure deems the algorithms equivalent, then 
this is denoted by A = x B. Usually, we merely define either -< x or < x and 
the other relations follow in the standard way from that. 

To streamline the presentation of results, we always assume that n > 2. This 
is because if the input sequence contains a single price, i.e., n = 1, the first 
and only price is also the last price. By the definition of the problem, the 
online player has to select that single price, and all online search algorithms 
are equivalent. 

The core of the paper is concerned with the comparison of 1Z P and lZ q for 
p ^ q. In order not to have to state this every time, we always assume that 
m < p < q < M. 
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3 Competitive Analysis 



Since its introduction, Competitive Analysis |13|, [TH| [15] has been the most 
widely used method for evaluating online algorithms. In fact, the online 
search problem was first studied from the online algorithm perspective using 
Competitive Analysis by El-Yaniv et. al. [11] . Competitive Analysis eval- 
uates an online algorithm in comparison to the optimal offline algorithm. 
Informally speaking, it considers the worst-case input which maximizes the 
ratio of the cost of the online algorithm for that input to the cost of the 
optimal offline algorithm on that same input. The maximum ratio achieved 
is called the competitive ratio. 

Definition 1 An online search algorithm A is strictly c-competitive if for 
all finite input sequences /, 

OPT(I) < c-A(I). 

The competitive ratio of algorithm A is inf{c | A is c-competitive}. □ 

Denote the competitive ratio of an online algorithm A by ca- If ca > cb, B 
is better than A according to Competitive Analysis and we denote this by 
A< C B. 

In [TT], El-Yaniv formulated the Reservation Price Policy algorithm and 
applied it to both deterministic and randomized search for real- valued prices. 
It was shown that the reservation price p* = V Mm is the optimal price for 
any deterministic online algorithm according to Competitive Analysis and 
using this price, the competitive ratio is y/M/m. A very similar result holds 
for integer- valued prices. 

Theorem 1 According to Competitive Analysis, 1Z P -< c lZ q , 1Z P = c 1Z q and 
lZ q -< c IZp if and only if Mm > p(q — 1) , Mm = p(q — 1) and Mm < p(q — 1) , 
respectively. 

Proof In any price sequence for an RPP algorithm 1Z P , we can observe two 
cases: (i) all the prices are less than p, in which case the performance ratio, 
offline to online, will be at most with equality when there is a price p— 1 
and the last price is m; and (ii) at least one price is greater than or equal 
to p, in which case the offline to online performance ratio would be at most 
^ with equality when the first price greater than or equal to p is exactly 
p and there is another price M somewhere later. So, the competitive ratio 
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of IZp will be Cft p = max(^-, ^). It is easy to observe that cn p > cn q if 
and only if — > 2^— since < and — > — . This argument proves 

J p m mm p q ° 1 

that IZp -< c 7Z q if and only if Mm > p(q — 1). Similarly we can conclude the 
other two results. □ 



Corollary 1 Let s = V Mm . According to Competitive Analysis, the 
best RPP algorithm is TZ S . 

Proof Assume that p < s. The comparison between 1Z S and 1Z P gives 



P 



Vm~' 



1 ) < Mm. Thus, \/p < s, 1Z p ^ c 1Z S 



Now, assume that q > s. Then the comparison between 1Z„ and 1Z S gives 



in 



(q - 1) > Mm. Thus, Vg > s, K q < c TZ S . 

□ 



Theorem 2 According to Competitive Analysis, TZp < c TZ p and lZ 2 p = c 1Z p 
if and only if p > m and p = m, respectively. 

Proof From the proof of Theorem Q3 we know that the competitive ratio of 
TZp is Cfc p = max f 2 ^, ^M. For the competitive ratio of TZp, we consider a 
price sequence with only one M followed by n — 1 occurrences of m. Clearly 
the competitive ratio is M/m, and it is the maximum ratio that can be 
obtained by any algorithm. So, c^2 > cn p , and equality holds if and only if 
p = m. □ 



4 Bijective Analysis 

In the Bijective Analysis model [I][2]> we construct a bijection on the set of 
possible input sequences. In this bijection, we aim to pair input sequences 
for online algorithms A and B in such a way that the cost of A on every 
sequence I is no more than the cost of B on the image of /, or vice versa, 
to show that the algorithms are comparable. We present a version of the 
definition from [I] which is suitable for profit maximization problems such 
as online search. 

Definition 2 We say that an online search algorithm A is no better than 
an online search algorithm B according to Bijective Analysis if there exists 
an integer uq > 1 such that for each n > uq, there is a bijection b : I n f-)- I n 
satisfying A(I) < B(b(I)) for each / G T n . We denote this by A<bB. □ 
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Theorem 3 According to Bijective Analysis, 7l p -<b Hq, if p = m and 
m < q < M. Otherwise, 7l p and 7l q are incomparable. 

Proof Consider the sequences with m < p. Note that with 7Z P , m will be 
chosen as output if and only if it is the last price of the sequence and all the 
preceding prices are smaller than p. As there are p — m such prices and, not 
counting the last price, there are n — 1 prices in the sequence, the number of 
possible sequence with m as output is (jp — m) n ~ l . With the same reasoning, 
for algorithm TZ P , each price in the range of m to p — 1 will be the output 
for (p — m) n ~ l sequences. 

For any prices in the range of p to M, algorithm 7l p chooses this price as 
output at its first occurrence in the price sequence if no price greater than 
or equal to p has occurred before it. So all the preceding prices before this 
first occurrence should be smaller than p (specifically in the range of m to 
p — 1) and all of the next prices can be any value. For example, the number 
of sequences where price p comes in the 3rd place in the sequence as well 
as taken as output will be (p — m) 2 N n ~ s . So the number of sequences with 
any value k in the range from m to M as output is 



where N p k is the number of sequences which give output k if the reservation 
price is p. 

Now we explore the different conditions on the values of p and q for com- 
parison of Tip and TZ q . Recall the assumption throughout the paper that 
q>p. 

Case p > m: From Eq. ([1]), we can derive the fact that when p > m, 
the number of the sequences with lowest output for algorithm TZ q {N q ^ m ) is 
greater than that of algorithm TZ P (N p>m ) since (q — m) n_1 > (p — m) n ~ 1 . 
Thus, we cannot have any bijective mapping b : X n <-)■ X n that shows 71 P (I) < 
lZ q {b{I)) for every I € X n . On the other hand, it is also the case that the 
number of sequences with highest output (M) for algorithm 7l q is greater 
than that of algorithm TZ p since N q> M > N P) m- So TZ P (I) > H g (b(I)) is 
also not possible for every I £ I n . Thus for this case, TZ P and 7l q are 
incomparable according to the Bijective Analysis. 

Case p = m: For algorithm 7l m , since the first price will be accepted, each 
price will be the output for exactly iV n_1 sequences. We can derive the 
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number of sequences with specific output for algorithm Tl q using Eq. ([T]) . In 
this case, each price in the range from m to q — 1 will emerge as output in 
(q — m) n ~ l sequences and the number of sequences with output in the range 

from q to M will be N n ~ l + (q - m)N n - 2 + (q - m) 2 N n - 3 H h(g-m) n_1 . 

Clearly, here we can construct a bijective mapping b : I n f-> I n where 
each sequence with output k < q of algorithm Tl m is mapped to sequences 
with the same output for algorithm Tl q . Let E m denote the number of 
excess sequences with output k < q of Tl m which cannot be mapped in the 
above way. We map each sequence with output k > q of algorithm Tl m to 
sequences with the same output in algorithm Tl q . Let E q denote the number 
of excess sequences with output k > q of lZ q which can not be mapped in 
above way. Clearly, E m = E q because the total number of sequences are 
the same in both algorithms. Note that, for all of these E m sequences, we 
can construct a mapping such that Tl m (I) < lZ q (b(I)). This mapping shows 
that Tl m (I) < K g (b(I)) for each I G 1„, but Tl m (I) > K q (b(I)) does not 
hold for all / 6 I n . This shows that Tl m and Tl q are comparable according 
to Bijective Analysis and Tl m -<b lZ q . □ 

Theorem 4 According the Bijective Analysis, 1Z 2 -<(, 1Z P if p > m, and 
Tip =6 Tip when p = m. 

Proof Let N p k denote the number of sequences which give output k for 
algorithm Tl? p if the reservation price is p. As in the case of Tl p , Tl p will 
choose m as the output if it is the last price of the sequence and all the 
preceding prices are smaller than than p. Prom the proof of the previous 
theorem, we know that there are exactly (jp — m) n_1 such sequences. In 
addition to those sequences, m will also be the output if the preceding n — 1 
prices have exactly one price greater than or equal to p. The above reasoning 
is valid for each price in the range of m to p — 1. So, 

jV p>fc = (p - m) n ~ l + {p- m) n ~ 2 (n - 1)(M -p + 1), for m < k < p (2) 

For any price in the range of p to M, algorithm Tl p chooses this price as 
output if in the price sequence there is exactly one price greater than or 
equal to p which occurs before it, or it is the last price and no other price p 
or larger occurred earlier. So the number of sequences with any output k in 
the range from p to M is 

n 

N p ^ k = ^2(p- m y- 2 (i-l)(M -p+l)N n ~ l + (p-m) n - 1 for p < k < M (3) 
i=i 
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From Eq. ([I]) and fl2J), it is evident that if p > m and n > 1, N Pt k > ^p,k for 
m < k < p. As the total number sequences is fixed and neither Eq. ((TJ) nor 
Eq. (j3J) depend on k, N p ^ < N p k for p < k < M when p > m. So, we can 
always build a bijective mapping b :X n o X n that has 7^(1) < Hp(b(I)) 
for every I £ I n , but the reverse mapping cannot be constructed if p > m. 
However, if p = m, then N p k = ^p,k f° r an y fe> So, according to Bijective 
Analysis, V? v -<j, TZ p if p > m and TZp =b Tip when p = m. □ 

4.1 Real- Valued Price Interval 

Note that, for real- valued instances of the problem, N is not finite. The 
result of comparing the two algorithms using Bijective Analysis changes 
dramatically when the values of the prices are real numbers. Bijective Anal- 
ysis cannot differentiate between algorithms when the number of sequences 
is uncountable. 

Theorem 5 1Z P and lZ q are equivalent according to Bijective Analysis if 
the prices are drawn from real space in [m, M\. 

Proof As any closed or open interval in real space has the cardinality of 
the continuum, the cardinality of [m,p] and [m, q] will be same. Taking the 
Cartesian product of such sets preserves their cardinality. So the cardinality 
of the set of sequences with any output, k, will be same for both algorithms. 
Hence, we can find a bijective mapping between the sequences where each 
sequence is mapped to another with same output. This shows that in this 
situation, all reservation price algorithms are equivalent according to Bijec- 
tive Analysis. □ 

The same problem clearly arises for other online problems with real-valued 
inputs. 

5 Average Analysis 

Using Bijective Analysis, algorithms would often be incomparable because 
it is impossible to find any mapping such that one algorithm dominates the 
other on all sequences and their images. However, in practical scenarios we 
often see that in spite of some exceptions, one algorithm performs much 
better than others for most of the cases. If we take the average performance 
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of any algorithm, then we can overcome this type of problem. In Average 
Analysis is defined with that aim and is here formulated in terms of online 
search. 

Definition 3 We say that an online search algorithm A is no better than 
an online search algorithm B according to Average Analysis if there exists 
an integer no > 1 such that for each n > no, YlieX < J2iex n ^(^)- 

We denote this by A ^ a B. □ 



Theorem 6 For all n > 



log(jV/(g-p)) 
log(JV/(JV-l)) 



1> ExeinKpil) <£ Je x n ^0O- 



Thus, according to Average Analysis, 1Z P -< a lZ q . 

Proof Let S PyTl denote the summation £j g j 7£ p (-/")■ For the online search 
problem, we can derive the value of S p ^ n using Eq. ([1]) as follows: 

p-l M 

i=m i=p 

p-l / n \ M 

= (p-m) n - 1 J2i+ (E(P- m )*" liVn ~ i )E i 

i=m \i=l / i=p 

= (p-m)"(p + m-l) | m)i _ KAjn _ t yM+p)(M-p+l) (4) 

_ (p-m) n (p + m- I) ^ ( N n - (p-m) n \ (N + m + p — 1){N + m-p) 



(5) 



2 \ iV - (p - m) 



where we have used that N = M — m + 1. 

To compare two algorithms, we essentially want to know if the difference 
between the corresponding two sums (Sg >n — Sp )Tl ) is greater than zero for 
some no > 1 and for each n > no- To derive the condition for 1Z P -< a lZ q 
using Derivation (j5J), we have 

^ gA^ n - pN n - {q - m) n N + (p - m) n N > Q 

^ N n-l > (g ~ m )" ~ (P ~ 
<? -p 
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Now we have to find a no > 1 such that for each n > uq, the condition of 
Eq. (|6j) is satisfied. If we choose no such that iV" 0-1 > ^ N ~l p ° , then the 
condition of Eq. ([6]) is fulfilled for no, as the maximum value of q — m is 
N — 1 and q > p. So, 

(no — 1) log N > n log(iV — 1) — \og(q — p) 
44> n (log N - \og(N - 1) > log N - log(g - p) 
log(JV/(g-p)) 
° > log(N/(N - 1)) 

(6) 

Eq. ((6|) gives a value for no of iog(N/(N-i)) ~^ ^ ^ or wn i cn f° r an n > n o, 
^2i£Z n ^p(-0 < S/ex„ ^(-O - This proves that 7£ p -< a 7£q according to 
Average Analysis. □ 

Corollary 2 According to Average Analysis, the best RPP algorithm is 

Proof According to Theorem [6j for any two RPP algorithm H p and H q 
with q > p, H p -< a H q . Thus, the maximal possible reservation price is best. 

□ 

Theorem 7 According to Average Analysis, H p -< a H p if p > m, and 
TZp = a H p when p = m. 

Proof To prove the relative performance of Hp and Tl p , we calculate the 
values of the expressions Yliez ^pCO aric ^ ^2iel n ^ , p(^)- ^° derive these 
values we use the expressions for N p ^ and N p k from Eq. CQ, ([2]), and ([3]) of 
the previous section. If p = m, then N p ^ = N P: k = iV n_1 for any value of 
k. Thus, if p = m, then Y, Ie x n ^K 1 ) = Ei e x n K P (I). 

Now we consider the case where p > m. From Eq. ([1]), we know that the 
N p k attain two distinct values, one in the range of m < k < p and the 
other in p < k < M, i.e., N Pjm = N p>m +x = . . . = N PjP -i and N p>p = 
N PtP +i = . . . = N P) m- This is also true for N P) k from Eq. ([2]) and ([3|). To 
prove H p -< a H p and consequently to show Yliez ^pOD < J2iex n ^p(-0> 
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we develop following identity. 

M M 
E = = N n 

k=m k=m 

^ (p - m)N p , m + (M - p + l)N pM = (p~ m)N p , m + (M — p + l)iVp )M 
4^ (M - p + l)(iV P)M - iV P)M ) = (p - m) (JVp, m - iV p , m ) 

(7) 

Note that both N Pj m~^p,m and N p>m —^p,m in the last equality are positive. 
Now we show that the difference between ^/ex n ^pCO an d S/ex„ ^pCO * s 
positive. 



E 


- E 








/6Z„ 






p-1 


Af 


p-1 


M 




+ E fcA P,M - 




- E ^p.M 


k=m 


fc=p 


k=m 


k=p 




M 




p-1 



= {N pM - N p ,m) E k ~ (^P> m ~ N p>™) E k 

k=p k=m 

(M ft , (M-p + l)(M + p) 7 >_ m )Cp + m _i) 

= \^p,M ~ ^pM) ^ {^p,m — ^p,m) ~ 

= (N p , M -N pM )(M- P+ l){^-^pl) (8) 
> (9) 

where the second to last step follows from Eq. ([7]), and the last step from 
M + p>p + m — 1 and N P) m > N Py M- 

This shows that S/eZn^pCO < S/ex n ^p(-0 an d accordingly proves that 
T^p ^-p if p > m, and lZ p = a 1Z p when p = m. □ 

From the definition of Average Analysis, we know that it calculates the sum 
of outputs from all possible input sequences. For integral valued problems, 
the sum of the outputs and the expected output over a uniform distribution 
can be derived easily from each other, and either of them can be used to 
compare two algorithms. In contrast, in the case of real-valued problem, 
calculating the sum of the outputs is not possible as the number of sequences 
is infinite. However, if we know the distribution of the input prices in the 
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sequences, then we can derive the expected output of a sequence. Here, we 
generalize Average Analysis to Expected Analysis. This generalization may 
prove useful for other online problems as well. 



Definition 4 We say that an online search algorithm A is no better than 
an online search algorithm B according to Expected Analysis if there exists 
an integer uq > 1 such that for each n > no, Ef^x„[A(I)] < Ei & x n [B(I)]. 
We denote this by A < e B. □ 

We denote the probability of the first price being from the range [m,p) by 
P m ,p and the probability of the first price being from the range [p, M] by 
Pp,M- Additionally we denote the expected value of the prices less than p 
by E mtP and the expected value of the prices greater than or equal to p by 
E P; m- We assume that the prices in an input sequence are independent and 
uniformly distributed over the range of [m,M]. If n = 1, then we can get 
the expected value of the output as P p> mE Pi m + Pm,pE m:P . Assume now 
that we are dealing with sequences of length two. Hence, with probability 
P Pt M, the algorithm 1Z p accepts the first price and with probability P m , P it 
will not. So, for n = 2, the expected value of the output will be P p> mE P; m + 
Prn,pPp,MEp^M+Pm,pPm,pE m ,p- Inductively, the expected value of the output 
for a sequence of length n can be calculated from that of sequences of length 
n — 1. 

n 

Elel„ [ftp CO] = Pp,M E P,M ^2 P m,p + E m,pPm,p ( 10 ) 

i=l 

To analyze the performance of any RPP algorithm using Expected Analysis, 
we derive the values of the required probabilities and expectations. For the 
real- valued case, P m , P = ^E^, P p ,m = jf^, ^m, P = E ^ L , and E PjM = 
For the integral case, P myP = , P P ,M = m-^+i » E m,p = 

P+ ™~ 1 1 ana - e p,m = % p ' ■ For the integral case of the algorithm 1Z P , the 
above values give 



E IeXn [Kp{I)] = 

(M —p+l)(M+p) A / p—m \ 1 1 _|_ p+m—l ( p—m 

2(M-m+l) 2^ I M-m+1 ) 2 I M-m+1 

i=l 

It is easily verifiable from the Eq. © that E IeIn [Kp(rj\ = S Pin /N n . Thus, 
Definition [3] and U] produce the same result as stated in Theorem [6] for the 
integral case. 
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It is clear that neither Definition [3] nor Theorem [6] can be used in the real- 
valued case. 

Intuitively, we can say that lZ m always chooses the first price of any sequence, 
whereas TZm does not choose any of the first n — 1 prices as Pm,m = and 
it has to take the last price. As all the prices are identically distributed, the 
expected value of the first price and the last price are same. That makes 
TZ m and TZm equivalent. For the rest of the cases, we denote the distance 
between m and M by U, i.e. U = M — m. This gives us the following. 

Proposition 1 In case of real-valued online search 

m A- M 

E IeIn [K m (I)] = E IeIn [K M (I)) = 
Thus, according to Expected Analysis, 1Z m = e TZm- 

Theorem 8 In case of real- valued online search, for all n > 

1, if either p > m or q < M, E IeIn [K p {I)} < E IeIn [R g {I) 
case, according to Expected Analysis, TZ P < e TZ q . 



+ 



log(E//(g-p)) 
log(U/(q-m)) 

Thus, in this 



Proof For the real-valued case, using Eq. (fT0|) . the expression Ej G x„[TZ p (I)] 
becomes 

tp n, mi (M-p)(M+p) <A fp-mV' 1 p + m fp-m 



2U H\UJ 2 \ U 

i=i x ' 



{p-m) n {p + m) {M+p)(M -p) ^ _ ^ 
2U n + 2U n m) 



u 

'—iTjn—i 



i=l 

1 



2U n 
1 



J_J n — (j) — TTl) 

(p-m) n {p + m) + (M + p)(M - p)- 



U — (p — m) 

[MU n +pU n -U(p-m) n ] 



2U nl 

(11) 

To prove that 7Z P -< e lZ q , it is sufficient to show that the difference between 
the corresponding two expectations is greater than zero for some uq > 1 and 
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for each n > uq. To derive this condition we use Eq. (jlip . 

E lEXn [K q (I)]-E IeXn [K p (I)}>0 
qU n - pU n -(q- m) n U + (p - m) n U 

2^ >0 

n-1 (g — m) n — (p — m) n 



u n ~ l > 



P 



(12) 



Since q < M, Eq. (|12p becomes similar to Eq. ([6]), with the only difference 
being that here U = M — m in place of N = M — m + 1. 

To get the value of no, we can follow the derivation of Eq. conclud- 



log(lVfa-p)) 

iog(by(?-m)) 



+ 1, 



ing that in the case of real-valued problems, for all n > 

Ei£i n [TZ p (I)] < Ei£z„[7Zq(I)], if either p > m or q < M. From the pre- 
vious statement and Proposition [JJ this proves that according to Expected 
Analysis, 1Z P < e 1Z„. □ 



6 Random Order Analysis 

Kenyon [16] proposed another method for comparing the average behaviors 
of online algorithms by considering the expected result of a random ordering 
of an input sequence. In [16], Kenyon defines the random order ratio in the 
context of the bin packing problem which is a cost minimization problem. 

Definition 5 The random order ratio RC(A) of an online bin packing al- 
gorithm A is 

RC(A)= hmsup 'p' n 

opt{i)-><x> 

where the expectation is taken over all permutations of /. □ 

In other words, the random order ratio is the worst ratio obtained over all 
sequences /, comparing the expected value of an algorithm, A, to the value 
of OPT, the optimal offline algorithm, with respect to a uniform distribution 
on all permutations of /. An online algorithm B is better than an online 
algorithm A according to Random Order Analysis if RC{A) > RC{B). We 
denote this by A -< r . B. Since the value of OPT(I) is bounded above by the 
constant M, the following definition, a maximization version of the definition 
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of random order ratio in p3], is used here in place of the original definition. 

OPT(I) 

BCVU-Hmg, X (13) 



Theorem 9 The random order ratio of the RPP algorithm lZ p is max(y, 
when p > 1 and p > m. Consequently, 1Z P -< r lZ q if and only if Mm > 
p(q - 1). 

Proof Considering the random order ratio of 1Z P , OPT always get the 
highest price in the sequence as its output and TZ P chooses the first price 
that is greater than or equal to p. There are two cases where the random 
order ratio could achieve the maximal value. First suppose the sequence has 
one price with value M and all other prices are p. Then 

= M(n-l) l+ *»-!)(,- 1)1 (14) 

Now substituting the expected value of the output of the algorithm 1Z P in 
Eq. (fT3|) . we can present the ratio as 

nM M 
hmsup — -. — = — (15) 

The other case is when the sequence has one price with value p — 1 and 
all other prices are equal to m. In this case, we can get a limit similar to 
Eq. (|15p of Pjj— when p > 1 and p > m. As we are seeking the maximum 
of these ratios, the random order ratio of 1Z P is the maximum of the two 
values, and when p > 1. This gives the same result as in the case 
of Competitive Analysis in Section [3J So, to prove the statement about 
the relative performance of 1Z P and lZ q , we can directly use the arguments 
provided in the proof of Theorem [TJ □ 

Corollary 3 Let s = V Mm . According to Random Order Analysis, the 
best RPP algorithm is 1Z S . 

Proof Since Random Order Analysis gives the same results as Competitive 
Analysis in comparing RPP algorithms, the best RPP algorithm is also the 
same (see Corollary [T]) . □ 
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Theorem 10 According to Random Order Analysis, TZp -< r TZ V and TZp = r 
1Z P if and only if p > m and p = m, respectively. 

Proof From the proof of Theorem we know that the random order 
ratio of TZ P is RC(TZ P ) = max(^-, ^). For the random order ratio of TZ p , 
we consider a price sequence with only one M and n — 1 occurrences of m. 
Clearly, OPT always takes M, whereas TZp never accepts the first occurrence 
of M unless it is the last price in the sequence. So, 

EAn>[I))] = M(»-D! + m(n -!)(„-!)! ^ 

Now, substituting the expected value of the output of the algorithm TZp in 
Eq. (|13p . we can present the ratio as 

RC(TZl) = lim sup — — ^ = — (17) 

V p> n -+oo M + m(n-l) m v ' 



This ratio is the maximum and worst ratio that can be obtained by any 



algorithm. So, RC{TZ P ) > RC(TZp), and equality holds if and only if p = m. 



□ 



Note that the conditions are exactly the same as in the case of comparing 
TZ p and TZ P using Competitive Analysis in Section [3] and the proof of this 
theorem follows the proof of Theorem [2j 



7 Relative Worst Order Analysis 

Relative Worst Order Analysis [5] compares two online algorithms directly. 
It compares two algorithms on their worst orderings of sequences which 
have the same content, but possibly in different orders. The definition of 
this measure is somewhat more involved; see [6] for more intuition on the 
various elements. Here we use the definitions for the strict Relative Worst 
Order Analysis for profit maximization problems. 

Definition 6 Let / be any input sequence, and let n be the length of /. 
Let A be any online search algorithm. Then 

A w (I) = mm AMI)). 

fj 

□ 
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Definition 7 For any pair of algorithms A and B, we define 

ci(A,B) = sup{c | 3b : VI : A W (I) > cB w (I)} and 
Cu(A,B) = mi{c\3b:\/I:A w {I)<cB w {I)}. 

If q(A, £?) > 1 or c u (A,B) < 1, the algorithms are said to be comparable 
and the strict relative worst order ratio WRa,b of algorithm A to algorithm 
B is defined. Otherwise, WRa,b is undefined. 

Hci(A,B) > 1 then WRa,b = c u (A,B), and 
if c M (A, 5) < 1 then WEa.b = Pi (A 

If WRa,b > 1, algorithms A and B are said to be comparable in A's favor. 
Similarly, if WRa,b < 1, algorithms are said to be comparable in B 's favor. 

□ 

When two algorithms happen to be incomparable, Relative Worst Order 
Analysis can still be used to express their relative performance. 

Definition 8 If at least one of the ratios c u (A, B) and c u (B,A) is finite, 
the algorithms A and B are (c u (A, B) , c u (B , A))-related. □ 

Theorem 11 According to Relative Worst Order Analysis, 1Z q and 1Z P are 
(y , 2^-)-related. They are comparable in TZqS favor if p = m and q = m+1. 

Proof We compare two RPP algorithms, 7£ 9 and 7£ p , with p < q, using 
strict Relative Worst Order Analysis. Notice that, unlike the other worst 
case analyses, we are not taking the worst ratio; rather, we are taking the 
worst profit from all the permutations of any sequence and then deriving 
the ratios. For the maximum value of the ratio of lZ Qw {I) and 1Z Pw (I), we 
can construct a sequence / with only one p and one M and all the other 
prices smaller than q. Among all the permutations of /, the worst output 
for TZ q is M and that of 1Z P is p. This gives the value of the upper bound 
c u (TZ q ,TZp) as y. For the lower bound, assume / has only one q — 1 and 
one m and all the other prices are smaller than p. Then, 1Z P takes q — 1 as 
its output on every permutation of I, but the worst output of 7Z q gives m. 
On this sequence, 1Z q performs worse than 1Z P , and the ratio of the outputs 
of the two algorithms can never be lower than that. So, 

. . m ( = 1 , forg = m+ l and p = m 

Cl {li q ,li p ) = — ^| <Xj ' otherwise 

M 

c u (TZq,TZ p ) = — > 1 
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From the above expressions and the definitions of strict Relative Worst Order 
Analysis, we can see that 7Z q and 1Z P are comparable when p = m and q = 
m + 1. For all the other cases, they are incomparable. For this single feasible 
condition (ci(lZ q ,lZ p ) = 1), we have WRfc qt ii p = ^ > 1, and we can say 
that algorithms lZ q and 1Z P are comparable in lZ q s favor. Using Definition [SJ 
since all the ratios are finite, c u (1Z p ,1Z q ) is and the algorithms 1Z q and 
K p are (f , ^-related. □ 



Note that this relatedness result gives the same conditions indicating which 
algorithm is better as Competitive and Random Order Analysis. Although 
the original definition of relatedness in Relative Worst Order Ratio does not 
tell explicitly which algorithm is better, we can get a strong indication about 
it from the next corollary. 



Corollary 4 Let s 



. Then \/q > s, if 1Z q and 1Z S are (c, d)- 



related then c < d and \/p < s, if 1Z S and 1Z P are (c, c')-related then d > c. 



Proof By Theorem QH c u (1l q ,K s 



As q > s 



\VMm | 



and c u (TZ s ,TZ q ) = S— . 



CuiTZq^lZg) < c u (lZ s ,lZ q ). On the other hand, 



A I 



and c u (JZ p ,1Z s 



As p < s 



□ 



This corollary shows that whatever the value of a; (i / s), c u (1Z s ,1Z x ) > 
c« ("72-a; j ^-s ) • This could be defined as a weak form of optimality within a class 
of algorithms, and we will say that 1Z S dominates any other RPP algorithm. 



Theorem 12 According to Relative Worst Order Analysis, 1Z P and lZ p are 
comparable in 7Z p s favor and WR^ -r^ = 

Proof From the proofs of Theorems [21 and [TUl we have already seen that the 
worst case performance ratio of 1Z P and 1Z p on the same sequence is M/m and 
this is the highest possible value. So we can conclude that c u (lZ p ,7Z p ) = 

For deriving the lower bound of this ratio, notice that, for any sequence, on 
its worst permutation of that sequence, lZ p s output will be at least as large 
as ftp's on its worst ordering of that sequence. We can prove this fact by 
taking the worst output of TZ P and lZ p over all the permutation of a sequence 
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/. Let x and y denote these outputs, respectively. If y < p, then there is no 
price in I smaller than y. So, the worst output of 1Z P must be greater than 
or equal to y, i.e., x > y. If y > p, it is the smallest price in / greater than p, 
so again x > y. So, ci(TZ p ,TZp) = 1. From Definition[71 we can conclude that 
according to Relative Worst Order Analysis, 1Z p and TZ p are comparable in 
ftp's favor and WTfo 772 = —. □ 



8 Relative Interval Analysis 



Dorrigiv et. al. [TO] proposed another analysis method, Relative Interval 
Analysis, in the context of paging. Relative Interval Analysis also compares 
two online algorithms directly, i.e., it does not use the optimal offline al- 
gorithm as the baseline of the comparison. It compares two algorithms on 
the basis of the rate of the outcomes over the length of the input sequence 
rather than their worst case behavior. Here we define this analysis for profit 
maximization problems for two algorithms A and B, following |10j . 



Definition 9 Let 



and 



Min A , B (n) = mm {A(I) - B(I)} , 

\I=n\ 



MaxA#{n) = max {A(I) - B(I)} 

\I=n\ 



These functions are used to define the following two measures: 

Min(A,B) = liminf — - and Max(A,B) =limsup- ' 4 " 



(18) 

Note that Min(A,B) = - Max(B, A) and Max(A,B) = - Min(B,A). The 
relative interval of A and B is defined as 



l(A,B) = [Min{A,B),Max(A,B)\ . (19) 

If Max(A, B) > I Min(A, B) \ , then A is said to have better performance than 
B in this model. In particular, if l(A,B) = [0,/3] for j3 > 0, then it is said 
that A dominates B since Min(A, B) = indicates that A is never worse 
than B and Max(A, B) > says that A is better at least for some case(s). 

□ 
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Now we turn to the comparison of the RPP algorithms 1Z P and lZ q . In this 
case, the output of the algorithms is not dependent on the length of the 
price sequence. So, the rate of the outputs over the length of the input 
sequence makes little sense; both Min(A, B) and Max(A, B) are zero for any 
algorithms. In online search, a more meaningful rate of output is over N, 
the number of possible prices. We assume that m is a finite integer. We 
have modified Definition [9] accordingly and calculate the rate of output over 
N, using N — > oo to derive the limits of Eq. (|18p . 

Theorem 13 According to Relative Interval Analysis, l(lZ q ,lZ p ) = [0, 1], if 
q G o(N). 



Proof For the minimum value of 1Z q (I) — 1Z P (I), we have any sequence of 
prices with all the prices smaller than q where the first price is q — 1 and 
the last price is m. In this case, Min-ji q ^i v {N) = m — q + 1. The maximum 
value of TZq(I) — Tlp{I) is M — p, when the first price is p and the second 
price is M. To compare 1Z P and 1Z q , we change Eq. (fTHl) and we have the 
following expressions: 

Min(TZ q ,TZ p ) = liminf — , and Max(lZ q ,7Z p ) = limsup — rr^- 

(20) 

AsA = M- m+ landm<gG o(N), these limits give l(K q ,K p ) = [0, 1]. 
This proves the theorem. Thus, 1Z q dominates TZ P . □ 

Theorem 14 According to Relative Interval Analysis, l(lZ p ,lZp) = [—1, 1], 
ifpG o(N). 



Proof For the minimum value of 1Z P {I) — lZ p (I), we use any sequence 
of prices starting with two prices in the order of (p, M). In this case, 
Minji 7^2 (N) = p — M. The maximum value of 1Z P (I) — Tl p (I) is M — m, 
which occurs when the first price is M and the other prices are m. The 
corresponding limits of Eq. (|20p are: 

Min{n p ,nl) = liminf P ~ M , and Max(TZ p ,TZl) = limsup M m , (21) 

Clearly, the above two limits give l(1Z p ,1Zp) = [—1,1] and according to 
Definition [9] we cannot conclude anything about the relative quality of these 
two algorithms. □ 
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Given the finite nature of the online search problem, we also propose an- 
other modification of Relative Interval Analysis removing the limits from 
the definition. 

Definition 10 Miring (n) and MaxA t is(n) are as in Definition 
These functions are used to define the following two measures: 

Min(A,B) = mf{Min A , B (n)} and Max(A,B) = sup{Max A ^(n)}. (22) 

Note that Min(A, B) = - Max(B, A) and Max{A,B) = - Min(B,A). The 
Finite Relative Interval of A and B is defined as 

fl{A, B) = [Min(A, B), Max(A, B)] . (23) 

Relative performance and dominance with regards to fl(A,B) are defined 
as for l(A, B) from Definition [9l □ 

Theorem 15 According to Finite Relative Interval Analysis, fl(lZ q ,7Z p ) = 
[m - q + l,M - p], and fl(R, p ,1l 2 p ) = [p — M, M — m]. 

Proof From the proof of Theorem [T3l we know that for any value of n, 
Minn^in) = m-q+1 and Max-ji q ,n p (n) = M-p. That gives fl(TZ q ,TZ p ) = 
[m — q + 1, M — p\. From the proof of Theorem [HI we know that for any 
value of n, Min^^^-Ajx) = p — M and Maxji p jii (n) = M — m. That gives 
fl(1Z p ,1Zp) = [p — M,M — m\. Together this shows that 1Z P has better 
performance than if p > m. □ 

Corollary 5 Let s = [" M + m "| . According to Finite Relative Interval Anal- 
ysis, the best RPP algorithm is 1Z S . 

Proof Let p < s. To compare 1Z S and 1Z P , we have Min(lZ s ,lZ p ) = m — 
pr±mj + 1 and Max (<ji^ np) = M - p > M - [M±a] as p < [^±^]. 

This shows that Vp < s, Max(lZ s ,1Z p ) > \ Min(lZ s ,1Z p )\ and consequently 
we can say that 1Z S performs better than 1Z P . Now assume q > s. Then 
a comparison between 1Z q and 1Z S gives Min(JZ q ,lZ s ) = m — q + 1 < m — 
^M±mj + x ag q > ^M±mj ^ and Max ^ n s ) = M-s = M- [^±S] . This 

inequality shows Mq > s, Max{JZ q ,TZ s ) < \ Min(lZ q ,lZ s ) \ and consequently we 
can say that 1Z S performs at least as well as lZ q . These two cases prove that 
1Z S is a best RPP algorithm according to Finite Relative Interval Analysis. 

□ 



23 



9 Max/Max Ratio Analysis 



In [3], Ben-David et. al. denned the Max/Max ratio for cost minimization 
problems. The Max/Max ratio compares an algorithm's worst cost for any 
sequence of length n to OPTs worst cost for any sequence of length n. If we 
want to preserve this worst output ratio behavior for profit maximization 
problems, essentially the analysis must take the minimum profits and could 
be named Min/Min Ratio Analysis. Here we define the Min/Min ratio by 
modifying the definition of the Max/Max ratio. 

Definition 11 The Min/Min ratio of an online algorithm A, wm(A), is 
M(OPT)/M(A), where 

M(A) = lim inf min A(I) In. (24) 

n->oo \I\=n 

□ 

In the online search problem, for any RPP algorithm, the minimum output is 
m for some sequence of length n. For example, the sequence of n consecutive 
prices of value m always has the output m. As m is a finite value, the limit 
of Eq. (|24p is zero for any algorithm. As online search problems are finite 
problem, Min/Min Ratio Analysis is not applicable in comparing online 
search algorithms. 

However, we can modify the previous definition to make it suitable for finite 
problems. 

Definition 12 The Min/Min ratio of an online algorithm A, wm(A), is 
M(OPT)/M(A), where 

M(A) = inf{min A(I)}. (25) 

\I\=n 

□ 

This definition gives M{OPT) and M{A) for any RPP algorithms A the 
same value m and consequently make the Min/Min ratio equal to 1. That 
makes every algorithm equivalent according to Min/Min Ratio Analysis. 



10 Concluding Remarks 

Our findings with regards to the study of performance measures are listed in 
the introduction and we will not repeat them here. Studying performance 
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measures and disclosing their properties and differences from each other is 
work in progress. With this study, we have added Online Search to the col- 
lection of problems that have been investigated with a spectrum of measures. 
More online problem scenarios must be analyzed this broadly before strong 
conclusions concerning the different performance measures can be drawn. 

One of the results of the analysis of online search, as explained in the paper, 
is that for an online player there are three choices for the optimal reservation 
prices, y/mM, m + M ; and M depending on the different analysis methods, 
i.e., the geometric mean, the arithmetic mean and the maximum of the 
values m and M. This clearly shows that the objectives of the different 
performance measures vary greatly, trying to limit poor performance in a 
proportional or additive sense, or focusing equally on all scenarios or placing 
emphasis on the limit. Thus, the different measures are tailored towards dif- 
ferent degrees of risk aversion — cautiousness vs. aggressiveness. These obser- 
vations complement the findings regarding greediness and laziness from [TJ. 
We would like to encourage researchers to study (fundamentally) different 
online problems in a similar fashion to increase our understanding of the 
focus points for different performance measures. 
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